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Abstract. Let X = S G where G is a countable group and S is a finite set. A 
cellular automaton (CA) is an endomorphism T : X — » X (continuous, com- 
muting with the action of G). Shereshevsky 1141 proved that for G = Z d with 
d > 1 no CA can be forward expansive, raising the following conjecture: For 
G = Z d , d > 1 the topological entropy of any CA is either zero or infinite. Mor- 
ris and Ward pill , proved this for linear CA's, leaving the original conjecture 
open. We show that this conjecture is false, proving that for any d there exist 
a d-dimcnsional CA with finite, nonzero topological entropy. We also discuss 
a measure-theoretic counterpart of this question for measure-preserving CA's. 



1. Introduction 

Cellular automata form a class of dynamical systems which has been extensively 
studied since the 1940's, going back to some work of von Neumann [15] and others. 
For some survey papers on different aspects of cellular automata see [21 El [9j [16]. The 
following is an intuitive description of a cellular automaton: Consider an infinite 
mesh of finite state machines, called cells interconnected locally with each other. 
These cells change their states synchronously depending on the states of some 
nearby cells, as determined by a local update rule. All the cells use the same 
update rule so that the system is homogeneous. 

The entropy of a cellular automaton is. informally, the rate of information flow 
required to describe the long term evolution of any finite number of cells. If the 
mesh of cells is a one dimensional array (bi-infinite or one sided) , a simple argument 
shows that the entropy must be finite. Intuitively, when the cells are arranged in 
a lattice of dimension 2 or more, it can be expected the entropy is either zero (the 
evolution of a finite number of cells is eventually determined by the history of these 
cells) or infinite (the rate of information to describe the evolution of a set F of 
cells grows to infinity with the cardinality of F). This intuition, backed up by 
some supporting results gave raise to the following conjecture [HUT], attributed to 
Shereshevsky: 

Conjecture 1.1. A d- dimensional cellular automaton, with d > 1, can not have 
finite, positive entropy. 

The main result of this paper is a counter-example to this conjecture. For any 
d > 2 we describe a Z d cellular automaton and give non-trivial bounds in its 
topological entropy An important tool implied in this construction is a certain 
aperiodic set of tiles, associated to a substitution system. The cellular automaton 
we describe was introduced by Kari [8] for d = 2, to prove certain undccidability 
results on cellular automata. 
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The paper is organized as follows: In section [5] we introduce notation and give 
brief definitions of cellular automata, subshifts and entropy. Section [2] concludes 
with previous results and background on the entropy problem for cellular automata. 
Section [3] consists of a construction of an automaton with non-trivial topological 
entropy, along with entropy estimations. Section [4] contains an explanation of a 
key ingredient for this construction - the so called "Hilbert-Tilcs" . Some tools 
developed in sections [3] and |4] are applied in section [5] to study measure-theoretic 
entropy of surjective cellular automata. The last section of this paper contains 
some further comments and open questions. 
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2. Preliminaries and background 

2.1. Subshifts and cellular automata. Let S be some finite set, which we call 
the possible states of each cell. A configuration is an element x £ S G , where G is 
a countable set. For n 6 G We denote by x n the state of the cell at coordinate 
n in the configuration x. If F C G, we denote by xf the restriction of x to F - 
the states of those cells located in F. We put the product topology on S , which 
is compact and metrizable. If G is a semigroup, we can define an action a of the 
group G on X by translations: For h,g £ G and x £ S G , (o- g x)h — X] lg . Each 
map a g is a continuous transformation of X , and if G is a group, {a g : g € G} are 
homeomorphisms. The classic cases are G = Z and G = N, in which case the action 
a is generated by one transformation, called the shift map. In this case, S' 1 (or S N ) 
is called a full shift space (one sided or two sided, respectively). If G = Z d where 
d > 1 then S z is a d- dimensional full shift. A subset IcS z which is closed and 
invariant to the action of a is called a Z d -subshift. Any subshift can be described 
by a set of forbidden blocks FB = {bi, . . . b n , . . .} where bi € S Fi and Fi C Z d are 
finite sets as follows: 

X = {x e s zd : x Fi+m ± bi Vm e Z d , i e N} 

A subshift X is called a subshift of finite type (SFT) if there exist a finite set FB 
of forbidden blocks for X. We say that a subshift X C is a factor of a subshift 
Y C S z (or Y extends X) if there exist a surjective map 7r : Y — > X which 
commutes with the shift action a. 

For a countable group G, a G-cellular automaton is a pair (S G ,T) where T : 
S G — > S G is a continuous transformation which commutes with the G-action a of 
translations. We abbreviate CA for cellular automaton. The transformation T is 
always of the form {Tx) n = t{xF+n) where F C G is a finite set, and t : S F — > S is 
called the local rule of the CA. Mostly, we restrict attention to the case G = Z d . 

Often a wider definition of a Z d -CA is used, and any continuous, shift commuting 
transformation of an SFT is called a Z d -CA. In this paper we deal specifically with 
CA on a full-shift. 

2.2. Topological and measure-theoretic entropy. Let (X, T) be a CA with 
X = S G , and F a finite subset of G. We denote: 

W{F n, T) := { ((x) F , (Tx) F , (T n ~ 1 x) F ) : x e X) 
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W(F, n, T) is the set of possible configurations for cells inside F along n iterations 
of T. 

The topological entropy of (X, T) is: 

h top {X 7 T) = sup lim -log\W(F,n,T)\ 

where the supremum above is over all finite subsets F of G, and the limit above 
exists by subadditivity of the sequence log |W(F, n, T)\. 

For to = (too, ■ ■ -,w n -i) £ W(F,n,T), let [to] = {x £ X : (T l x) F = w { < i < 
n}. Let V(X,T) be the set of probability measures on the Borel cr-algebra B of X 
which are invariant to T {^{T^B) = fi(B) any Borel B C X). For fx £ V(X,T). 
The measure-theoretic entropy of {X, p, T) is: 

hn(X,B,T) = sup lim — H n 

FcG n —°° n 

with: 

H n = - M(M)log(M(N)) 

wGW(F,n,T) 

where the supremum is again over all finite subsets F of G, and the limit above 
exists by subadditivity of the sequence H n . Both the quantities /i top (X, T) and 
hfi^X, B, T) indicate the "information flow" of the long term evolution of any finite 
number of cells by T. The conceptual difference is that the topological entropy 
gives the rate of information required to describe any evolution of finitely many 
cells, where as h^(X, B,T) gives the rate of information required to describe a 
"typical" evolution, where "typical" is with respect to the probability p. 

An important result connecting the topological entropy and the measure theo- 
retic entropy, known as the variational principle states that: 

h top (X,T)= sup hp(X 7 B,T) 

ti€V(X,T) 

Entropy of a transformation (topological or measure theoretic) is defined in a 
broader context. See [5] for definitions, proofs and a detailed discussion in the 
context of compact spaces. 

2.3. Substitution systems and tilings. A 1 d -tiling system consists of a finite set 
S of "square tiles" and some adjacency rules R C S F with F = {0, ±ei, . . . , ie^}, 
which determine when a tile s\ is allowed to be placed next to a tile S2 (and in 
which directions). A configuration x £ S F for some F C Z d is valid at n £ F if the 
neighbors of the cell at n obey the adjacency rules: xf+u £ R- Evidently, the set 
of infinite valid configurations in S are an SFT. We call this SFT the associated 
subshift of (S, R) and denote it by Xr. 

A 7L d -substitution system consists of a finite set S and a substitution rule p which 
is a function p : S — > S Fk where Fk = {1, . . . , k} d . The function p naturally extends 
to a map p n : S — » S Fk " by applying n iterations of p, and to a map p : S 1 " — > S" z . 
For F C 1 d and a configuration xp £ s F , we say that xp is admissible for the 
substitution system (S,p), if it appears as a sub-configuration of p n (s) for some 
s £ S and n G N. To a substitution system (S, p) there is an associated subshift 
X p , whose forbidden blocks are the non-admissible blocks for (S,p). 

We say that a substitution system a has the unique derivation property if any 
for x £ X p there exist a unique n £ Fk and y £ X p such that x = a n p{y)- 

3 



Equivalcntly, this means that given a part of a finite configuration x G S Fk " such 
that x = p n (s) for some s G S which has been shifted, the shift can be recovered 
uniquely modulo k1 d . Mozes [T5], based on some earlier work of Robinson [T5] , 
devised an algorithm for implementing a subshift associated with a substitution 
system via local constraints - a tiling system. Namely, Mozcs proved the following 
theorem: 

Theorem 2.1. (Theorem 4.5 of [12],) Let X p C S z " be the Z d -subshift associated 
to a substitution rule s : S — > S Fk with unique derivation. If d > 1, then there 
exists a tiling system (S,R) such that the associated subshift Xr extends X p . 

To be precise, Mozes proved this theorem for d — 2, but the proof extends to 
any d > 1. In fact, Goodman-Strauss [6] proved a more general result, relaying on 
Mozes' techniques, which implies theorem l2.1l for any d > 1. For d = 1, thcorcm l2.ll 
does not hold: there are classic examples of one-dimensional substitution systems 
which are not factors of an SFT. 

2.4. The CA entropy problem. We turn to explain some motivation for conjec- 
ture [TJ A G-CA (S G , T) is expansive if there exist some finite FcG such that for 
any x / y G S G there exist n > such that (T™x)f ^ (T n j/)_p. Expansiveness of a 
CA means that by observing the states of some finite number of cells under itera- 
tions of F, we can eventually distinguish between any 2 configurations. It can be 
shown that an expansive CA always has finite, non-zero topological entropy. Shcrc- 
shevsky [14] proved that a Z d -CA with d > 1 can not be expansive, which gave raise 
to conjecture!!] stated in the introduction. Motivated by this, Morris and Ward [TT] 
proved a result on entropy of group automorphisms, which implies this conjecture 
for some subclass of cellular automata called linear cellular automata. This result 
has been refined [4], to show that linear CA are either "sensitive to initial condi- 
tions" , in which case the entropy is infinity, or equicontinuous, in which case the 
entropy is zero. Lakshtanov and Langvagen [lOj prove that any multidimensional 
cellular automaton which admits a spaceship has infinite entropy. A spaceship for 
a CA {X, T) is configuration x G X which differs from a er-invariant configuration 
in only finitely many cells, and such that T k x = a n x for some n G Z d \ {0} and 
some integer k > 0, but x is not itself er-invariant. 

We point out that for any d > 1 there are trivial examples of continuous, shift 
commuting transformations T : X — > X with finite, positive entropy where X C S z 
is an SFT: 

Let 

X = {x G S 1 : x n — x n+ei VI < i < d} 

where {ei, . . . , e<j} are the standard generators of Z d and T(x) = a ei x is the shift 
in the direction of e\. In this case, the example is essentially 1-dimcnsional, and 
the topological entropy of T is log 

3. SURJECTIVE Z d CA WITH FINITE NONZERO ENTROPY 

In this section we present a construction of a surjective Z d -CA, associated with 
a set of directed tiles S and a finite group T. This is a simple generalization of 
Kari's CA [8]. We prove that if S has some special properties, the associated CA 
has non-trivial entropy. The existence of a set of directed tiles with the required 
properties is proved in section [4] 
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A set of directed tiles is a tiling system with a forward direction d(s) £ {±ei, . . . , ie^} 
associated to each tiles s £ S. Given a configuration x £ S , a path defined by a; 
is a sequence pi,j»2j ■ • • with p n £ Z d obtained by traversing the forward directions 
of x: Pn+i = Pn + d(x Pri ). Given x £ S , a path {p„} is valid if x is valid at every 
p n . A set of directed tiles S, such that no valid path in x £ S' 2 '' forms a loop is 
called an acyclic set of tiles. 

Fix a finite group T. The group operation of T is written here in additive 
notation. Let S be a set of directed set of tiles. Recall that for s £ S, d(s) denotes 
the forward direction of the tile s. 

Define T s : X -> X with X = (S x Tf" as follows: 



In this cellular automaton cells "transmit-information" along valid paths. We prove 
that when the number of infinite valid paths is bounded, the topological entropy is 
finite. 

For x £ X, denote by j(x) n the T-part of state of the cell at n in x, and by 
s(x) n the S'-part of the state. 

Lemma 3.1. With S an acyclic set of tiles as above, and Tg r defined according 
to equation (|3.2[) . T$,r is surjective. 

Proof. It is sufficient to prove that the image of Tsj 1 is dense in X, that is. to any 
finite F C If 1 and any y £ X there is some x 6 X such that {Ts,tx)f = Vf- Let 
y G X and F C Z d a finite set. We describe iflas follows: Set s(x) n = s(y) n 
for any n € Z d . For n 6 Z d \ F, set 7(x)„ = (the identity of the group T). It 
remains to define the "f(x) n for n G F. We define 7(x)„ itcratively. according to 
the length of maximal valid path in x beginning at n, which remains in F. Since 
S is acyclic and F is finite, any such path must be finite. If x is not valid at n, or 
the successor of n in x is not in F, define r y{x) n = r y(y) n - Suppose now that the 
length of the maximal valid path in x beginning at n is k > 1, and we have defined 
r y{x) n +d(x n ). So we define j(x) n = j(y) n — l{x) n +d(x n )- It can now be verified that 
indeed (Ts } tx)f = Vf- D 

Suppose S is an acyclic set of tiles, and w £ S' 1 " . Let X w = {(x,y) £ S zd x 
r z : x = w} and identify it with naturally as a subset of X. The set X w is a 
closed subset of X, and is invariant under T$,t- Let us define a directed graph 
G w = (V W ,E W ) with vertex set V w = Z d and the edges 



We say that K C 7L d is connected in G w if for any two cells in K there is a 
directed path in G w from one to the other (but not necessarily in both directions). 
A connected component of G w is a connected set in G w which is maximal with 
respect to inclusion. For any connected component K of G w , and any x £ X w , the 
CA Ts,r acts on xk independently of the states outside K. 

Fix w £ S z . Suppose G w has c infinite components, denoted by K\, . . . ,K C . 
Let K = Z d \ U- =1 K c denote the union of cells which are not part of forward 
infinite valid path in w. Let (Xi, T{) denote the system corresponding to those cells 
in Ki with the action of Ts,r- The systems (Xi,Ti) are factors of (X w ,Ts : r)- 



(3.1) 




{(n, n + d(w n )) ■ n £ If 1 , w is valid at n] 
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For w £ iS" z , denote by I(w) the number of infinite connected components of 
G Wl which is equal to the maximal number of pairwise disjoint, forward infinite 
valid paths in w. For a directed set of tiles S, let: 

I(S) = sup I(w) 

Lemma 3.2. Let (Xq,Tq) be the system corresponding to the cells which are not 
part of forward infinite valid paths as above, htop(Xo,To) = 0. 

Proof. Since any valid path in Xq is forward finite, a simple induction on the length 
of the path shows that the sates of the cells in a valid path of length at most k 
is 2 fe -periodic. Thus, (X ,T ) is isomorphic to an inverse limit of (finite) periodic 
systems, and thus has topological entropy. □ 

Lemma 3.3. Let X w ,and Ts,r be as above. If w £ S z contains exactly c forward 
infinite disjoint valid paths, then h top (X w ,Ts.r) = clog|r|. 

Proof. With the above notations, since T acts independently on cells in different 
connected components, (X w ,Ts,r) is isomorphic to Yli = o(Xi,Ti), and so 

c 

1 1 top 

i=0 

By lemma l3~2l the topological entropy of {X , T ) is 0. Each of the other systems 
(Xi,Ti) has topological entropy log | T since it is isomorphic to an inverse limit of 
finite extensions of the N-CA on T N defined by: (Tx)„ = x n + x n +\. 

□ 

In the next section we describe Kari's directed set of tiles from [8j, called Sh- 
The tile set Sh is acyclic and has < I(Sh) < oo. In fact, we show that this 
construction can be carried out in any dimension d > 1. For this set of tiles Sh and 
some fixed group T, denote Th = Ts H ,r- Assuming this, we have our main result: 

Theorem 3.4. For any d > 1 there exist a surjective ifi-CA with positive, finite 
topological entropy. 

Proof. Let Sh be an acyclic set of directed tiles with < I(Sh) < oo. By lemma 
13.31 this means that sup ujgSZ 2 htop(X w , Th) = I(Sh ) log |T| < oo. Since X = 
l±) weS z 2 X w , we have that h t0 p{X,T H ) = sup^^ h t op(X w ,T H )- In scctionHwe 
will prove the existence of Sh as above, which will complete the proof. □ 

Before describing the set of tiles required to complete the proof of theorem 13.41 
we not that a slight modification of the above construction yields the following 
result about the possible values the topological entropy of multidimensional CA 
can obtain: 

Proposition 3.5. For any d>l, The set of entropies of surjective d- dimensional 
cellular automata is dense in [0, oo) 

Proof. Since a product of surjective d-dimcnsional cellular automata also a surjec- 
tive d-dimcnsional CA with topological entropy equal to the sum of the entropies, 
it is sufficient to prove that there exist surjective d-dimensional CA with arbitrarily 
small positive topological entropy. 
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Figure 4.1. The four basic paths through the squares of size 2x2 tiles. 



Retaining the notations from the beginning of this section, let T be some finite 
group, S an acyclic set of tiles with < I(S) < oo and 1 m the cyclic group of order 
m. We define a CA 

T SX ,n :(SxTx Z m ) -^(SxTx Z ro ) 

by: 

, , , , / (x n ,y n + y n +d(x „), 1) if x is valid at n and t = 

(3.2) T s , r , m (z,j/,i)„.= j (a^.i + l) otherwise 

Evidently, T$ .r.m is surjective (the proof is similar to lemma [3~Tj) . Also note that 
r™ r m is conjugate to T s r x id, and so 

htop(Ts,r, m ) = —hto P (Ts,r) 

Since < ft.t p(Ps,r) < oo an d m was arbitrary, the proof of this proposition is 
complete. □ 

4. Kari's tiles and Hilbert space filling paths 

In this section we describe Kari's set of directed tiles Sh, which has the properties 
announced above. In order to prove our main result, we only need two properties 
from this set of tiles Sh- The first property is < I(Sh), that is, there exist x £ S H 
with a forward infinite valid path. The second property, which is harder to prove, 
is I{Sh) < oo. This property of Sh follows from a lemma proved by Kari (quoted 
here as lemma I4.2|) . In the first part of this section (subsection 14. ip we describe 
a substitution system which is associated with Kari's set of tiles. Subsection 14.21 
contains a technical description of Kari's tiles, and it may be skipped by readers 
who are familiar with [8J. The last part of this section contains a proof that Kari's 
tiles have a bounded number of forward-infinite valid paths. 

4.1. Hilbert space filling paths. Before describing Kari's tiles, let us describe a 
certain substitution system, which is closely related with these tiles. Consider the 
discrete version of Hilbcrt's plane filling curve. This is a path in Z 2 which, starting 
at (0, 0) visits each point of the non-negative quarter of 1? once. Following is an 
inductive definition of this path: Define four basic paths which visit each point in 
a 2" x 2™-squarc. We denote these paths by P£, P„, P^, and P%. Pf, is defined as 
(0,0) — > (0, 1) — > (1, 1) — > (1,0). The other basic paths are obtained by rotations 
and reflections. These 4 basic paths are described in figure [44] The path P° +1 is 
obtained by walking according to P%, P°, P° and P°. Similarly, P* +1 , P„+i aim 
Pn+i arc defined inductively as shown in figure l4~2l 
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Figure 4.2. The inductive step n in the definition of a Hilbert path. 




A Z d -Hilbert path can also be defined in an analogous manner: the basic paths 
are obtained by traversing the vertices of a <i-dimensional hypercube using Gray- 
code. In dimension d there are 2d basic paths, corresponding to the d generators and 
their inverses (see Alber and Niedermeier (Tj for more on Z d -Hilbert type paths). 
For simplicity, we first consider only the case d = 2. 

We can associate a substitution system to the Hilbert path: there are 12 tiles 
in this system, each corresponding to a basic path with the inward and outward 
directions indicated. The substitution rules reflect the inductive step of the defini- 
tion of this path. The tiles and one of the rules of this substitution system is are 
described in figure 1*01 The other substitution rules follow in a symmetric manner, 
according the definition of the Hilbert path. 

Lemma 4.1. The substitution system associated with the Hilbert tiles (described in 
figure \4^4\ ) has unique derivation. 
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Figure 4.4. The tiles for the Hilbert substitution system, and a 
substitution rule. 




FIGURE 4.5. The five basic labels of tiles: (a) bold cross (b) blank 
cross (c) bold arm (d) blank arm (e) mixed arm. 



Proof. It can be directly verified that any tile in the interior of a valid configuration 
is a part of a unique path of length 4 which fills a 2 x 2 square. Now consider 
a 1? configuration in the associated subshift. The lattice Z 2 is partitioned into 
2x2 squares each of which is tiled by a path of length 4. This partition uniquely 
determines the substitution rule applied to derive the Z 2 configuration. □ 

By the result of Mozes (theorem l2.1j) . there exist a set of tiles which implements 
the Hilbert substitution system. We do not know however, if any tiling system S 
which implements the Hilbert substitution system has the property that < I(S) < 
oo. Kari's tiles, which are a specific set of tiles which implement this substitution 
system, do have this property. We suspect that by applying the algorithm described 
by Mozes in [12] on the Hilbert substitution system, one also ends up with a set of 
tiles with the required properties. 

4.2. Description of Kari's tiles. We now describe Kari's tiles, which we denote 
by Sh- This directed set of tiles has "direction" labels, which are defined in such 
a manner that any valid path follows part of the Hilbert path. The construction 
is similar to an aperiodic set of tiles constructed by Robinson [13] , which is also at 
the heart of Mozes' result [T2] . 

Each tile has a basic label which is cither a blank cross, a bold cross a blank arm, 
a bold arm or a mixed arm. The five types of basic labels are represented in figure 
14.51 A tile with a basic label which is an arm can face in one of the four main 
directions (north, south, east or west). Each cross also has an orientation label in 
NE,NW,SE,SW refereing to the four cornerwise directions. The tiles labeled with 
an arm contain one arrow which faces outwards, and two arrows facing inwards. We 
call the arrow facing outwards a principal arrow and the arrows facing inwards side 
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Figure 4.6. The possible orientation labels of the two side arrows 
of a bold arm. X e {E, W} and Y G {TV, S}. 




Figure 4.7. The possible orientation labels of the two side arrows 
of a mixed arm. 




Figure 4.8. The labeling of mixed arms whose principle arrow 
has the label a. 



arrows. Each arrow in an arm also contains an orientation label in NE,NW,SE,SW. 
The principle arrow of an arm can be labeled with any of the four orientations. 

There are restrictions on the orientation labels of the side arrows, determined by 
the direction of the arm, and the type of the arm (see figure |4"1)|) : For a bold arm in 
which the principle arrow is horizontal, there are two possibilities: either the upper 
side arrow is labeled with SE and the lower one with NE, or the upper arrow is 
labeled with SW and the lower one with NW. If the arm is vertical, then either the 
left arrow is NE and the right arrow is NW or the left arrow is SE and the right 
arrow is SW. The possible orientation labels for size arrows in bold arms are shown 
in figure [4~6l The orientation labels for size arrows in a blank arm are similar to a 
bold arm (figure l4~6|) . The possible orientation labels for arrows in mixed arms are 
shown in figure [4~7l 

Each arrow head also has a Hilbert-label in {a, 6, c, d}. The only restriction 
imposed on the Hilbert-labels concern crosses and mixed arms. In each cross all 
four arrow heads must have the same Hilbert-label. The Hilbert-labels of the side 
arrows on the mixed arms are restricted according to the direction and Hilbert-label 
of the principle arrow. The restrictions can be obtained from figure l4~2l as follows: 
If the Hilbert-label of the principle arrow is x G {a, 6, c, d}, and the principle arrow 
is facing right, then the upper side arrow has the label of the path in the upper 
right corner of the square of P% + i, and the lower side arrow has the label of the 
path in the lower right corner of the square of P„+i- For mixed arms facing the 
other directions, the restrictions are defined in a similar manner. For example, 
figure 14.81 shows the allowed labels of side arrows for mixed arms whose primary 
arrow is labeled a. 
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a)0, b )l 1 c) x y 



1 1 U U y X 

Figure 4.9. The possible corner-parity labels on (a) horizontal 
arms (b) vertical arms (d) crosses (x,y <E {0,1}) 



Each tile has four corner-parity label in {0, 1}, each corresponding to a corner 
of the tile. In a tile which has a horizontal arm the top corner labels are both 0, 
and the bottom corner labels are both 1. In a tile which has a vertical arm the top 
corner labels are both 1 and the bottom corner labels are both 0. A tile with a 
cross has two possible labeling for the corner parities, with opposite corners having 
the same parity and adjacent corners having different parities. The possible corner 
parity labels are shown in figure 14.91 

There are two more labels for each tile: a horizontal-parity label and a vertical- 
parity label, both of which are in {0, 1}. The restrictions on these labels are as 
follows: For a blank cross, both these parity labels must be 0. For all other basic 
tiles (bold crosses and arms), at least one of these parity labels must be 1. 

In addition each tile has a direction label, which is in {N,S,E,W}. These 
direction labels determine the direction function d : Sh — * {N, S, E, W}, which 
make Sh a directed set of tiles. 

Let us describe the adjacency rules for these tiles, which define when a tiling is 
locally valid. For a configuration to be valid around a tile the following conditions 
must hold: 

(1) For any arrow head facing outwards, the arrow head must meet an arrow 
tail. 

(2) Any arrow head facing inwards must have an arrow head which meets it's 
tail. 

(3) The orientation labels and Hilbcrt-labels of meeting arrow heads and tails 
agree. 

(4) Corner-parity labels of adjacent corners agree. 

(5) Both horizontal and vertical parity labels alternate. 

(6) The direction label is valid, as explained below. 

We now explain the rules which determine when the direction label is valid (rule 
the direction label of a blank cross is valid if and only if one of the following 
conditions are fulfilled: 

(1) The direction is N and either the NW neighbor is a bold cross with Hilbert- 
label b or a vertical arm whose right side arrow has Hilbert-label a or d. 

(2) The direction is W and either the NW neighbor is a bold cross with Hilbert- 
label d or a horizontal arm whose lower side-arrow has Hilbert-label c or 
b. 

(3) The direction is S and either the SE neighbor is a bold cross with Hilbert- 
label c or a vertical arm whose left side arrow has Hilbert-label a or d. 

(4) The direction is W and either the SE neighbor is a bold cross with Hilbert- 
label a or a horizontal arm whose lower side-arrow has Hilbert-label c or 
b. 
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FIGURE 4.10. Inductive step in definition of Bxy{n + 1) . 

For a tile which is not a blank cross, the direction label is valid if it agrees with 
the direction label of a neighboring blank cross whose direction label points at this 
tile. 

This completes the description of Kari's tiles and their adjacency rules. 

It is possible to extend Kari's construction to a Z d tiling with any d > 2. The 
details are lengthy but there are no conceptual difficulties. We comment that these 
extensions arc related to "multidimensional Hilbert paths" . 

4.3. Bounding the number of infinite valid paths. To complete the proof of 
theorem 13.41 for d = 2, it remains to show that < I{Sh) < oo. 

We now show that there exist an infinite valid path for Sh- By induction, we 
define sequences of valid Sff-configurations of squares of size (2 n_1 + 1) x (2" _1 + 1), 
and denote these by B Y y(n) with X E {N, S} and Y 6 {E, W}. B X y(0) is a blank 
cross with orientation-label XY. B X y{ti + 1) is obtained by surrounding bold cross 
with orientation label XY by 4 configurations BsE{n), Bsw(n), B^y/in), Bne(ji), 
with arms labeled correctly as in figure 14.101 The configuration Bxy{2) with 
Orientation-labels on the crosses is illustrated in figure 14.111 The reader can verify 
that it is possible to fill the parity labels and corner-parity labels of these config- 
urations so they remain valid. This was proved by Kari [S]. We now explain how 
to add Hilbert-labels and directions to Bxy{n) so that the configuration remains 
valid. By induction on n, we can show that there exists a unique way to add these 
labels so that the central cross has Hilbert-labcl x £ {a, b, c, d}. The Hilbert-labels 
of each of the four surrounding squares BxY(n — l) arc determined by the inductive 
definition of the Hilbert path (as in figure 14. 2p . The labeling of the paths is deter- 
mined by a Hilbert-path which traverses all blank-crosses within this square. These 
configurations define arbitrarily long valid paths, and so by compactness there exist 
an infinite valid path for Kari's tiles (corresponding to a Hilbert path). 

Our next goal is to prove that I(Sh) < oo. For this we quote the following 
technical lemma, about the structure of valid paths in the tiling system Sh- 
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Figure 4.11. Bxy{2) with Orientation-labels on the crosses. 



Lemma 4.2. (Kari [Sj, lemma 5) For each x £ S\ ifpi, ■ ■ ■ ,Pn is a valid path in 
x , and N > 2-4™, then there are integers 1 < i < j < N with j — i = 4™ so that 
the path Pi, . . . ,Pj fills a 2™ x 2™ square. 

Kari's proof of this lemma involves a delicate examination of the tiles Sh ■ We 
comment that it is easier to prove the corresponding statement about paths which 
are admissible configurations for the substitution system (Sh,Ph)- However, ap- 
plying theorem 12.11 to deduce the result for the tiling system is non-trivial, since 
this lemma refers to configurations of which only some part (the path) is assumed 
to be valid. Using lemma I4~2l we obtain the following: 

Lemma 4.3. Suppose x £ S\ and the cells in pi, . . . ,pn form a valid path in 
x. There exist a square F C If centered at p\ which contains all the cells of the 
path, such that the path fills up an e-fraction of the cells in F . The constant e is 
independent of x and of the path. 

Proof. Suppose pi, . . . ,p N is a valid path with 2 • 4" < N < 3 • 4' 1 (if 3 • 4™ < 
TV < 4 • 4™, we look at a prefix). By lemma [4~2l there must by some 1 < i\ < 4™ 
such that the path p^, . . . ,pi 1+ ^ fills a square of size 2™ x 2™. If i-y > 1 , let 
Tii = [log 4 (zi)J . Apply lemma I4T21 on the path p^-^i, . . . ,^^+4^-1, and deduce 
that p^-^i, .. .,pi ± fills a square of size 2™ 1 x 2™ 1 . Let 22 = i\ — 4" 1 , continue 
in this manner applying lemma 14.21 on path segments of sizes 2 • 4™ J . Each time 
set nj = Llog 4 (-ji)J , and ij+\ = ij — 4"^, until ij = 1. Each path segment fills a 
square of size 2 7H x 2 ni . The sizes of the rij 's are non- increasing, and there can be 
no more then 3 nj 's of the same size. Repeat the same procedure on the suffixes of 
the path pi 1+ 4^, . . . ,pn, this time the ij's increase until ij = N. We obtain that 
maxi<ij<AT \\Pi — Pj\\oo < 6^™=o ^\ an( i so the entire path is contained inside a 
square of size 2 n+3 x 2™ +3 , centered at pi, of which it fills at least 2 • 4™ cells. This 
completes the proof of the lemma, with e = = ^3- ^ 
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Wc now use lemma |4~31 to show that the number of forward infinite valid paths 
in any configuration on the Hilbert tiles is bounded: 

Lemma 4.4. For each x G Sfj there exist at most M = \-~\ disjoint forward 
infinite valid paths in x, where e is the constant from lemma \J73\ 

Proof. Fix some x G . Suppose there are more then M = \-] forward infinite 
valid paths in x, and fixes cells ci, . . . , cm+i with Cj a cell in the i'th path. For any 
sufficiently large N, by lemma 14.31 each of these paths fill fills up an e-fraction of 
the cells in a 2 N x 2 N -square centered around q. As N tends to oo, each of these 
paths also fill almost an e-fraction of the same square of size 2^ x2 N . As the paths 
are disjoint, we reach a contradiction. □ 

It follows from lemma l4~4l that I(Sh) < M. On the other hand, we have seen 
that I(Sh) > 0. This concludes the proof if theorem 13.41 We remark that it can 
actually be proved by a more detailed examination of this system that there can 
be at most 4 disjoint forward infinite valid paths in any x G Sfj . Also, there exist 
x G Sjj with exactly 4 disjoint infinite valid paths in x. Using these observations 
one can exactly compute the topological entropy of Sh- 

5. Measure-theoretic entropy of surjective CA 

This section contains a discussion of surjective CA's as measure preserving dy- 
namical systems, and the measure-theoretic entropy of these systems with respect 
to a "natural" measure. 

Denote the symmetric Bernoulli measure by fx: the state of each cell is distributed 
uniformly and independently of the other cells. The following simple proposition 
was already noted in the earliest dynamical systems study of CA for the case G = Z 
(see Hedlund's fundamental paper [7]): 

Proposition 5.1. If G is an amenable group, any surjective G-CA is measure 
preserving with respect to the symmetric Bernoulli measure fx. 

Proof. First, note that the action a g : S G — > S G of G on S G by translations preserves 
fi. The measure theoretic entropy of this G- action is equal to the topological entropy 
of this action, and fx is the unique cr-invariant measure with this property- fi is 
the unique probability measure of maximal entropy for a. Now consider the set 
S = {v G V(S , B, <j) : fx = v o T^ 1 } of cr-invariant probability measures. This set 
S is non-empty since G is amenable. For any v G 5, T : (S G , B, v, a) — > (S G , B, fx, a) 
is a measure-theoretic factor map, and so h v (S G ,B,a) > hfj,(S G ,B,a), but since fx 
is the unique measure of maximal entropy for a, it follows that v = fx. □ 

The closed support of fx is S G for any countable G, and so any continuous map 
which preserves fx must be surjective. It follows that for an amenable group G, a 
G-CA is surjective iff it is ^-preserving. 

It is interesting to note that the above characterization of surjective CA does 
not hold for general countable groups: Consider the free group on two generators, 
denoted by F2. We describe a surjective F2-CA which does not preserve the sym- 
metric Bernoulli measure fx on {0,I} F2 : Denote 2 generators of F2 by a,b, and 
consider the CA M : {0, 1} F2 — > {0, 1 } F2 defined by the local rule determined by 
"majority vote" of x wa ,x w b and x wa -i. 
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Proposition 5.2. The the cellular automaton M : {0, 1} F2 — > {0,1} F2 defined as 
above is surjective, but does not preserve fj,. 

Proof. To sec that M does not preserve /z, let 

A = {x G {0, 1} F2 : x a -i ji x a } 

Obviously, n{A) = \. The pre-image of A under M is all the points x G {0, 1} F2 
such that the state of cell at the identity disagrees either with both the cells at a~ 2 
and a -1 b or with both the cells at a 2 and at ab: 

M~ 1 A = {Xi ^ X a -2 = X a -l b }A{xi ^ X a 2 = Xab} 

It follows that n(A) = | but /j,(M~ 1 A) = |, so T does not preserve the measure 

/i. 

To see that M is surjective, we prove that for any finite F C F2 and any y G 
{0, 1} F2 there exist x G {0, 1} F2 such that {Tx)f = Vf- Consider the finite graph 
G with vertex set F and edges {(iui,ii>2) G F x F : w\w 2 l G {a, b, a -1 , 6 -1 }}. 
Since G has no cycles, its edges can be directed so that each connected component 
is a directed tree. By adding extra cells to F, we can assume that G is a 3-rcgular 
directed tree. Now we can define x: If 101,102, ^3 are the children of w G F, define 
%Wi ■— Vw for i = 1 ... 3. Define the other states of other cells in x in an arbitrary 
way. It follows that indeed (Tx)f = Vf- □ 

Since the symmetric Bernoulli measure is preserved by any surjective Z d -CA 
T, one can study the measure theoretic entropy of T, which is bounded by the 
topological entropy. 

Proposition 5.3. The 1 2 -CA associated with Kari's Hilbert-tiles which we denoted 
by Th in section\^has measure theoretic entropy zero with respect to the symmetric 
Bernoulli measure. 

Proof. Recall that for each w G , we denoted by X w all the points x £ X with 
directions determined by w. Since the sets X w are all T^-invariant, and form a 
partition of X, almost any ergodic component of [i with respect to Th is contained 
in some X w . Let F\ and F 2 be squares centered around the origin of dimensions 
2 N x 2 N and 4-2^x4-2^ respectively. Suppose there is a valid path staring inside 
F\ and leaving F2. By lemma |4~2I such path must fill a square of size 2 N x 2 N 
contained inside F 2 . F 2 contains less then 16 • 4 N squares of size 2 N x 2 , and at 
least one of them must be valid. The ^-probability for a square of size 2 N x 2 N to 
be valid is exponentially small in 4 N , and so the /^-probability of the event that a 
valid path starting in F\ leaves F 2 tends to exponentially as TV — > 00. The Borel- 
Cantlli lemma implies that almost surely this does not happen for infinitely many 
iV's, and so with fi probability 1 there is no infinite valid path. By lemma [3~2l when 
w has no infinite valid path, [i w is supported on a set with zero topological entropy. 
We conclude that /x-almost every ergodic component of /z has measure-theoretic 
entropy. □ 

In a private communication, Ron Pcled suggested that with an appropriate set 
of acyclic tiles, Ts,r defined by equation (|3.2[) can be a (surjective) CA with finite 
non-zero measure theoretic entropy with respect to /1. To see this, apply the Ts,r 
construction with the acyclic tile set S = with no adjacency restrictions. 

With probability 1 a configuration has 1 forward infinite path, and any pair of 
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forward paths eventually coincide. Using lemma [3~3l we deduce that /i-almost any 
crgodic component of this CA has entropy log |T|. On the other hand, this CA has 
infinite topological entropy. 

6. Concluding remarks and questions 

Our investigation of the existence of a multi-dimensional CA with finite non-zero 
entropy was motivated by the misleading intuition explained in the introduction. 
We conclude with some related questions and remarks. 

Since the CA Th described in section[3]is not injective, a question which follows 
naturally is: 

Question 6.1. Does there exist an automorphism of a Z d full shift (an injective 
Z d -CA) with positive, finite topological entropy for d > 1? 

The discussion of measure-theoretic entropy of surjective CA in section [5] raises 
the following question: 

Question 6.2. Does there exist a 2-dimensional surjective cellular automaton with 
positive measure theoretic entropy (with respect to the symmetric Bernoulli mea- 
sure), and finite topological entropy? 

One can study dynamical properties such as entropy of cellular automata over 
any countable group. We remark that if G is a countable group which is not 
finitely generated, X = E G and T = X -> X is an G-cellular automaton then 
h(T) G {0, oo}. Here is an explanation of this fact: Since T is given by some 
local rule, there exist some finitely generated subgroup H < G such that each 
cell only interacts via T with other cells in the same H-coset. Since G is not 
countably generated, [G : H] = oo, and so (X, T) is conjugate to the infinite 
product riaeG/H( , -' IH ' T), and so must have infinite or zero entropy. We ask: 

Question 6.3. Does there exist a finitely generated, countable group G such that 
any G-CA has either zero or infinite topological entropy? 
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